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Several classes of generalized inverses of a given mX n matrix are considered. A collection of 
continuous maps is given, each of which maps a class of generalized inverses onto a stronger class and 
the elements of the stronger class are the fixed points of the map. For the case of EPr matrices one of 
these maps is studied in more detail. The various classes of generalized inverses are characterized 
as subspaces of the space of all n X m matrices. 
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1. Introduction 

Several classes of generalized inverses of a given m X n matrix A are considered. 

In section 3 it is shown that the ability to construct a generalized inverse of the weakest class 
provides the ability to construct a generalized inverse in any one of the stronger classes. Then a 
collection of continuous maps is given each of which maps a class of generalized inverses onto a 
stronger class of generalized inverses that remains fixed under the map. In section 4 we charac- 
terize these classes of generalized inverses as subspaces of the space of all nX m matrices and 
examine in more detail one of the maps given in section 3. 

2. Preliminaries and Definitions 

We consider only matrices with complex entries. For any matrix M we denote by p(M) , R{M) , 
N(M) and M* the rank, range, null space and conjugate transpose of M. By / we denote an identity 
matrix the order of which will be clear from the context. By V k we denote a /-dimensional vector 
space over the complex field. If Si and S* are any two sets we denote by Si — S2 the set of all ele- 
ments which are in Si and not in S2; by Si U S2 the union of Si and S2; by Si • S 2 the intersection 
of Si and S2; and by Si ^ S2 denote that Si is a subset of S 2 . We recall that a homeomorphism is a 
continuous map which is one to one, onto and has a continuous inverse. 

When the matrix A is nonsingular, we denote in the usual way by A~ l the inverse of A. For 
generalized inverses we adopt a special terminology as follows: We define five classes of general- 
ized inverses. For a given matrix A, C\{A) is the set of all matrices B such that ABA = A; C 2 (A) is 
the set of all matrices BeC\(A) such that BAB = B; C 3 {A) is the set of all matrices BeC 2 (A) such 
that AB is Hermitian; Cy{A) is the set of all matrices such that BeC 2 (A) and BA is Hermitian; and 
C 4 (A) is the set of all matrices such that BeC 3 (A) and BeC 3 '(A). We call a matrix BeCi(A), a 
Converse of A, i= 1,2, 3, 3', 4. This classification of generalized inverses has been used in previous 
work to which we will refer [4, 5, 6] l and related there to other systems of nomenclature which 
are in use. We note here that the C 3 '-inverse is the Goldman-Zelen weak generalized inverse [3] 
and that C 4 (A) = C:i(A) • Cy{A) is a single matrix, the unique Moore-Penrose generalized inverse 
[10]. There are many statements regarding a C.rinverse which of necessity hold for the CV-inverse 
(see [5], other examples occur in sec. 4). But there are contexts in which the role of elements of 
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CM) and Cy{A) are quite different (see Theorem 7). It is clear that CM) ^ CM) ^ CM) ^ CM) 
and that C 4 (A) ^ C,>(A) ^ C 2 (A) ^ Ci(A). We define four classes of strict generalized inverses 
as follows: A strict Ci-inverse of A is any matrix Be{C\{A) — C 2 {A))\ a strict C 2 -inverse of A is any 
matrix Be{C 2 (A) — C,(A) U C : v(A)): a strict C 3 -inverse of A is any matrix Be(C 3 (A) — C 4 (A)); a 
strict Cr-inverse of A is any matrix B€{Cy{A) — C*(A)). We will sometimes say BeC\{A) and is 
strict, meaning that B is a strict Ci-inverse of A, and when it is clear from the context that B is in a 
given class we will simply say that B is strict when it is a strict member of that class. Consideration 
of strictness leads to alternative characterizations of the classes of generalized inverses defined 
above and studies of this type were first carried out by Rohde [11, 12]. For example, Lemma 1 
below, gives necessary and sufficient conditions for BeC\(A) to be strict. If certain demands 
are made on A, and especially if demands are made on A and a generalized inverse of A, there 
may exist no strict generalized inverses in a certain class. Such cases are known [5] and others 
appear in section 4. 

Finally we recall that a matrix A is called an EP matrix if N(A) =N(A*), in particular if A is 
EP and p(A) =r we say that A is an EPr matrix [8], or merely that A is EPr. For ready reference 
we record the following known lemmas (one dealing with EP matrices) to which repeated reference 
will be made. 

Lemma 1. The matrix B is a Ci-inverse of A if and only if BA is a projection and p(A) = p(BA): 
and if and only if AB is a projection and p(A) = p(AB). //BeCi(A), then p(B) ^ p(A) with strict 
equality if and only i/BeC 2 (A). 

The first statement of Lemma 1 is Corollary 1 of [4]. The second statement combines Lemmas 
1 and 2 of [4], both proved in a different way by Rohde [12]. 

Lemma 2. Let P be an n X m matrix, Q and R^emXn matrices. If PQ is a projection such that 
p(PQ) = p(Q) and N(R) = N(Q), then RPQ = R. 

LEMMA 3. P* = P*QP if and only if QeC,(P) and N(P) = N(P*). Further, P* = P*QP if and 
orc/yi/P* = PQP*. 

Lemma 2 is Lemma 3 of [4] and Lemma 3 is Corollary 2 of [4]. 

3. Maps and Constructions 

We take for granted the existence of, and known methods for constructing, a C\ -inverse of 
an arbitrary matrix 2 [1, 11]. The first theorem shows that the ability to construct a Ci-inverse 
of an arbitrary matrix gives us the ability to construct a matrix in any given class of the five classes 
of generalized inverses which we have defined. 

Theorem 1. Let A be a given matrix. Define H = A*A, J = AA* and let BieCi(A), KeCi(H), 
Led(J) and MeC 3 (H). Then 

(i) B 2 = BiABi is in C 2 (A) and every matrix in C 2 (A) can be so expressed for some BieCi(A). 

(ii) B3 — KA* is in C 3 (A) and every matrix in C,{A) can be so expressed for some KeCi(H). 

(iii) B.v — A*L is in C3'(A) and every matrix in C 3 '(A) can be so expressed for some LeCi(J). 

(iv) B 4 = MA* is the Converse of A. 

(v) Let p(A) = p(A 2 ). Then B = AWA is in C 2 {A) and commutes with A if and only i/WeCi(A 3 ). 

PROOF, (i): That B 2 = B\AB\ is in C 2 (A) is a special case of a known theorem [4]. That every 
matrix in C 2 (A ) can be so expressed is obvious, (ii): If #3 = KA * we have B&4 = KH. Then by Lemma 
1, B?A is a projection, p{B%A) = p(H) = p(A) and thus B 3 eCi(A). By Lemma 1, p{B,) ^ p(A) 
but also p(B,) =p{KA*) ^ p(A). Hence p(B :i ) =p(A) and, by Lemma 1, B,eC 2 (A). By Lemma 1, 
AB.i is a projection with rank p(A) and from AB :i = AKA* it is clear that N{AB,) =N{{AB,)*) 
and AB, is Hermitian. Thus B,eCM). Conversely if B 3 eCM) we have B :i = B,AB, = B,B$A* 
and we have to show that B,B*eC\ [H). But by Lemma 1, B,A is a projection with rank p(A)=p(H) , 
and B,A=B,B$H shows, by Lemma 1, that B,B%eC\ (//). (iii): The proof of (iii) parallels that of (ii) 
in an obvious manner, (iv): Let B 4 = MA*. Then by (ii) we have B 4 eCM)- We now observe that 
B 4 A = MH is Hermitian and hence B 4 eC 4 {A). We note that conversely if B 4 eC 4 (A) we have 
B 4 = B 4 BU*, and B 4 B 4 *eC 4 {H) [10]. (v): If JFeC, (A% then by Lemma 1, WA* = (WA' 2 )A is a projec- 

2 See also (i) of Theorem 4. 

104 



tion with rank p(A [i ) = p(A) and WA 2 eC x {A). This being the case we have, by Lemma l,AWA 2 = BA is 
a projection of rank p(A) and BeCi(A). But p(B)^p{A) and hence, by Lemma 1, BeC 2 (A). The 
projections AB = AWA and BA = AWA 2 clearly both have null space N(A) and range #(^). 
Thus AB = BA. Now assume £eC 2 04) and AB = BA. ThenAWA* = A 2 BA 2 = A* shows that WediA 3 ). 
This completes the proof of the theorem. 

REMARK: Goldman and Zelen [3] have proved that B [V = A*N is in C 3 '(A) if NeC 2 (J), and that 
every matrix in Cy(A) can be so expressed for some NeC 2 (J). The above proof of (iii) shows that 
this theorem goes through under the weaker condition NeCi(J). However we note that \i BeC 3 {A) , 
then BB* is in fact in C 2 (H). For, in the proof of (ii) we have shown BB*eC\{H) , and from Lemma 1 
andp(^i5*)-p(^) = p(^) = p(//),wehave^*6C2(//).Bythesamekindofargument^*5eC 2 ( l /) 
whenever BeC^'iA). 

It is well known that for any matrix A, the C 4 -inverse of A exists and is unique. The next 
theorem gives a set of mappings which map an arbitrary CVinverse onto a stronger class of inverse 
and fixes the stronger class of inverse. These maps are continuous and have differentiability proper- 
ties of which considerable use is made in a subsequent paper [7]. 

We first give two lemmas which deal with the difference of two Ci-inverses. 

Lemma 4. //Bi andB> are in Ci(A) then A(Bi — B 2 )A = 0. Conversely, if AD A = Q, then for any 
B,eC,(A) we have (B, + D)eC,(A). 

PROOF. The proof is obvious from the definition of C\{A). 

Lemma 5. If ADA = then D= P N DP R + D(I — P R ), where P N and P R are any projections onto 
N(A) and R(A), respectively. Conversely, for any D of the form D = P N Zi -fZ 2 (I — P R ), where Zi and 
Z 2 are arbitrary matrices such that the indicated products exist, we have ADA = 0. 

Proof. If ADA = 0, then P N DP R = DP K . We now have D = DP R + D(I -P R ) = P N DP R + D(I - P R ) 
and the first statement is proved. The converse is obvious since (I — P R )A = and each column of 
P.vZ, is 'mN(A). 

Theorem 2. Let A be an m X n matrix, B + the C 4 -inverse of A, P N and P R any projections 
onto N(A) and R(A), respectively, and B an n X m matrix. Then 

(i) <MB) = B + + P N (B-B + )P R +(B-B+)(I-P R ) is in d(A) and<p 1 (B)=B if and only if 
Bed (A). 

(ii) (p 2 {B) = BAB is in C 2 (A) whenever BeCi(A). In this case, <p 2 (B) = B if and only i/BeC 2 (A). 

(iii) <p 3 (B) = BAB + is in C 3 (A) if and only if BeCi(A). In this case, <p 3 (B) = B if and only if 
BeC 3 (A). 

(iv) <£> 3 '(B) = B + AB is in C,r(A) if and only i/BeCi(A). In this case, <^ 3 '(B) = B if and only if 
BeC 3 '(A). 

PROOF. 

(i) Let C = ip\{B) — B + . Then by the second part of Lemma 5, ACA = and, by Lemma 4, 
i p l {B) = B+ + C is in Ci(A). If BediA), then A(B-B + )A = and, by the first part of Lemma 5, 
we \mveC = B-B + , but then B + + C = <p l (B) = B. Conversely if <pt{B) = B then Bed(A). 

(ii) If BeCi(A), that (f 2 (B)eC 2 (A) is a special case of a known theorem [4]. If BeCi(A) then 
ip 2 (B) = B if and only if BeC 2 (A) follows from the definition of C 2 (A). 

(iii) If BeCi(A), by a known theorem [4] we have ip 3 (B)eC 2 (A). But A(p 3 (B) = AB + shows that 
A(p 3 {B) is Hermitian and hence <p 3 (B)eC 3 {A). Conversely, if ip 3 (B)eC 3 {A), then (p 3 (B)A = BA is a 
projection with rank p(A), and by Lemma 1, BeCi(A). If BeC 3 (A) then the projections AB and 
AB+ are Hermitian and we have N(B)=N(B + )=N(A *). From Lemma 2 it follows that B=BAB + =<p 3 (B). 

(iv) The proof of (iv) is an obvious parallel of that of (iii). 

It is known that every square matrix of rank r has C 2 -inverses which are EPr [4]. When A 
is EPr the construction of Converses which are EPr is particularly simple. 

Theorem 3. Let A be EPr. Then i//(B) = BA*B* is in C 2 (A) and is EPr whenever BeC 2 (A). In 
that case i//(B) = B if and only ifB is EPr. 

PROOF. That i//(#) is in C 2 (A) and is EPr when B is an arbitrary matrix in C 2 {A) is Lemma 5 
of [4j. If B is EPr, then, since BeC 2 (A) implies AeC 2 (B), we can apply Lemma 3 to write B = BA*B* 
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4. Subspaces of Generalized Inverses 

In this section we will characterize the classes of generalized inverses previously discussed 
as subspaces of the space of all n X m matrices with complex entries viewed as a vector space 
j/nm over t ne complex numbers. 

THEOREM 4. Let A be an m X n matrix of rank r. Then 

(i) The collection of all C\-inverses of A is an ajfine space in V nm of dimension nm — r 2 . 

(ii) The collection of all Co-inverses of A is an algebraic variety in V nm which is homeomorphic 
to a linear space of dimension (nm-r)-(m-r) (n — r). 

(iii) The collection of all C^-inverses of A is an ajfine space ofY nm of dimension (nm — r 2 ) — (n — r) 
r — (n — r) (m — r) = r(m — r). 

(iv) The collection of all Cy-inverses of A is an ajfine space of\ nm of dimension r(n — r). 

PROOF: Any matrix A can be written as QMR where Q and R are unitary and M=i J 

with D diagonal and nonsingular and with p(D) = p(A) [2]. It is easily seen that BeCj(A) if and 
only if RBQeCi(M), i=l, 2, 3, 3', 4. Let RBQ=(*L ^Y Then the following may be derived 

directly from the definitions of the types of generalized inverses considered. 

(i) Bed (A) if and only if U=D~\ 

(ii) BeC 2 (A) if and only if BeC x (A) and X= WDV. 

(iii) BeCz(A) if and only if BeC 2 (A) and V=0. 

(iv) BeC y (A) if and only if BeC 2 (A) and W=0. 
The dimension and nature of the subspaces given in the theorem then follows from the dimension 
of the matrices V, W, and X not fixed by the requirement that B belong to a particular class of 
generalized inverses, and from the nature of the stated relations among them. 

In case A is n X n and is EPr we have the following theorem. 

THEOREM 5. Let A be n X n and EPr. Then the EPr matrices of C 2 (A) form an algebraic variety 
of\ n which is homeomorphic to a linear space of dimension r(n — r). 

PROOF. Since A is EPr it is known [8] that there exists a unitary matrix Q such that 




where A\ is rXr and nonsingular. It is easily seen that BeC 2 (A) if and only if 

IA? U X 
Q- l BQ = [ 

\V VA,U/ 

where U and V are arbitrary. By applying the map i// of Theorem 3 we see that BeC 2 (A) is EPr 
if and only if 

/A- 1 A^A*V*\ 
Q~ l BQ = i 

\V VA*V* J 

The theorem follows immediately from equating these two expressions. 

When A is EPr the question of strictness of generalized inverses of A becomes rather special. 
The following lemma shows that when A is EPr, there exists no strict C2-inverse which commutes 
with A, no strict C,3-inverse and no strict C.y-inverse. 

Lemma 6. Let A be EPr. Then the intersection of the set of all EPr C 2 -inverses of A with C ;J (A) 
(or with C 3 '(A)) is the C^-inverse of A which in this case is the unique C 2 -inverse of A which commutes 
with A. 

106 



PROOF. If BeCM) and is EPr then we have that AB is Hermitian and N(AB) = N(B) =N(A). 
Also N(BA) = N(A) and N((BA)*)=N(B). Thus N(BA)=N((BA)*) , fl/* is Hermitian and 
BeC±(A). An exactly parallel proof shows that if BeCv{A) and is £7V then BeC 4 (A). It is known 
that for any G such that p{G) = p(G 2 ) there exists a C 2 -inverse which commutes with G and this 
matrix is uniquely determined by G [5]. If A is EPr, then p(A) = p{A 2 ) [8], and there is a unique 
BeCz(A) which commutes with^. By a known theorem [9], a matrix commutes with its C 4 -inverse 
if and only if the matrix is EPr; and, by this very theorem, the Converse of an EPr matrix is itself 
EPr. Thus, since the C 4 -inverse of A is in G 2 (A) and commutes with A, it is the unique BeC 2 (A) 
which commutes with A and that unique BeC 2 (A) must be EPr. This completes the proof of the 
lemma. 

REMARK. Lemma 6 shows that in Lemma 2 of [5] the condition of normality can be weakened 
to EPr. 

We now use Lemma 6 to study the strictness of the EPr CVinverses of an EPr matrix as estab- 
lished by the following theorem. 

THEOREM 7. Let A be EPr and let i// be the map of Theorem 3. Then i// sends all ofC-s'(A) to 
C 4 (A) and the remainder of C 2 (A) into the set of all strict C 2 -inverses of A which are EPr. 

PROOF. From Lemma 3 we have 

Aty{B)=ABA*B* = A*B* 

xl,{B)A = BA*B*A = BA. 

Since \\){B)€.C 2 {A) and is EPr, by Theorem 3, we have by Lemma 6 that if i//(#) is not strict, then 
\\){B)€Ca{A). It follows from the display that if ifj(B) is not strict then BeC.y(A). Conversely if 
BeC;r(A) then the display shows that ip{B)eC4{A). Thus t// sends all of Cy(A) and only elements in 
C:y{A) to Ci(A). The remainder of C 2 {A) are those elements in C 2 (A) which are strict and those 
in C:\{A) which are strict. We now show that i// sends these elements into strict CVinverses. If 
BeC.i{A) and is strict, then BA is not Hermitian and the display shows that neither A\\)(B) nor 
\\f{B)A is Hermitian and ijj(B) is strict. Assume that ifj(B) is not strict. Then, by Lemma 6, \fj(B)eC4(A). 
But we have shown that i// sends only elements of C-y{A) to Ca(A) and therefore B is not strict. 
Thus if BeC 2 (A) and is strict, \\){B)eC 2 {A) and is strict. 

We observe that if A is EPr, then by the same kind of proof given for Theorem 3, \\)\{B) = B*A *Z? 
is in C 2 (A) and is EPr whenever BeC 2 (A). Moreover, when BeC 2 (A), \jj\(B)=B if and only if 
B is EPr. We then have the following parallel of Theorem 7: i//i sends all of C :i (A) to C*{A) and 
the remainder of C 2 (A) into the set of all strict ^-inverses of A which axe EPr. 
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